Lecture 3 
Basic sorting algorithms 



Array filling with random numbers 



//Example 1 
using System; 

namespace BasicSorting 
{ 

class Examplel 
{ 

static void Main() 
{ 

int[] nums = new int [10]; 
Random rnd = new RandomQ; 
for (int i = 0; i < 10; i++) 

nums[i]=rnd.Next(); 
DisplaylntArray(nums); 

Console. WriteLine( "Press any key to continue:"); 
Console. Read(); 

} 

static void DisplayIntArray(int[] intArray) 
{ 

for (int i = 0; i < intArray. Length; i++) 
{ 

Console. WriteLine(" Element {0} is {1}", i, intArray[i] ) ; 

} 

} 

} 

} 



Bubble sort 



• is one of the simplest sorts to 
understand and implement 

• Is one of the slowest sorting 
algorithms available 

• values "float like a bubble" from one 
end of the list to another 
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• The code to swap two array elements is written inline rather than as a subroutine 

• Simply, from the start of the array, compare each adjacent two numbers. If they are in the 
desired order leave them as they are. Otherwise, swamp them. 

• After each pass, there is one number that took its correct place, so there is no need to pass by 
it again. 

• Why upper ends at 1? Why inner stops at outer-1? 

• Is it descending or ascending order? How to change that? 



Bubble Sort 



Simply, from the start of the array, 
compare each adjacent two 
numbers. If they are in the desired 
order leave them as they are. 
Otherwise, swamp them. 
The code to swap two array 
elements is written inline rather 
than as a subroutine 
After each pass, there is one 
number that took its correct place, 
so there is no need to pass by it 
again. 

Why outer ends at 1? Why inner 
stops at outer-1? 

Is it descending or ascending order? 
How to change that? 



1 // example 2 

2 using System; 

3 Bnamespace BasicSorting 

4 l< 

5 B class Example2 
{ 

7 E static void Main|() 

{ 

int[] nuras = new int[10]; 
Random rnd = new RandomQ; 
for (int i = 0; i < 19; i++) 
nuras[i] = rnd. Next (100); 
Console. WriteLine("The unsorrted array: "); 
DisplaylntArray(nums); 

Console. WriteLine( "The sorted array using bubble sort: "); 
BubbleSort(nums); 
DisplaylntArray(nums); 

Console. WriteLine( "Press any key to continue:"); 
. Read ( ) ; 

} 

static void BubbleSort(int[] intArray) 
{ 

int temp; 

for (int outer = intArray. Length-1; outer >= 1; outer--) 
{ 

for (int inner = 0; inner < outer; inner++) 

if (intArray[inner] > intArray[inner +1]) 
{ 

temp = intArray [inner] ; 
intArray[inner] = intArray[inner + 1]; 
intArray[inner + 1] = temp; 

} 

} 

} 

static void DisplayIntArray(int[] intArray) 
{ 

for (int i = 0; i < intArray. Length; i++) 
{ 

Console. WriteLine("Element {0} is {1}", i, intArrayfi]) 

} 

} 



Selection sort 



• starting at the beginning of 
the array, comparing the 
first element with the other 
elements. If a smaller one 
found, swap it with the first 
location 

• the sort then begins again 
at position 2 

• This continues until each 
position, except the last 
position, has been the 
starting point for a new loop 
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Selection Sort 



The outer loop moves from the 
first element in the array to the 
last element 

The inner loop moves from the 
outer +1 element of the array to 
the last element, looking for value 
that are smaller than the element 
currently being pointed at by the 
outer loop 

After each iteration of the inner 
loop, the most minimum value in 
the reset of the array is assigned 
to its proper place in the array 
Is it descending or ascending 
order? How to change that? 





using System; 


- 


namespace BasicSorting 




{ 




class Example3 




( 


7 E 


static void Main|() 




{ 

int[] nums = new int[18]j 




Random rnd = new RandomQ; 




for (int i = 8; i < 18; i++) 




nums[i] = rnd. Next (188); 




Console .WriteLine( "The unsorrted array: "); 




DisplaylntArray(nums); 




Console. WriteLine( "The sorted array using bubble sort: "); 




SelectionSort(nums); 




DisplaylntArray ( nums ) ; 




Console. Writel_ine( "Press any key to continue:"); 




Console. Read(); 




} 


- 


static void SelectionSort(int[] intArray) 




{ 




int min, temp; 




for (int outer = 8; outer < intArray . Length-1; outer++) 




{ 




min = outer; 




for (int inner = outer + 1; inner < intArray . Length; inner++) 




if (intArray[inner] < intArray[min] ) 




min = inner; 




temp = intArray [outer]; 




intArray[outer] = intArray[min] ; 




intArray[min] = temp; 




} 




} 




static void DisplaylntArray ( int [] intArray) 




{ 




for (int i = 8; i < intArray. Length; i++) 




{ 




Console. WriteLine( "Element {8} is {1}", i, intArray[i] ) ; 




} 




} 
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Insertion sort 

• starting at the second 
element in the array: 

• Save a copy of the element 

• Move the preceding 
elements one position 
down until finding the 
correct position for the 
saved element 

• Put the saved element in 
the correct position 



Insertion Sort 



• The outer loop moves from the 
second element in the array to 
the last element: The element at 
the outer loop index is saved 

• The inner loop moves from the 
outer loop element of the array to 
the second element, looking for 
the element greater than or equal 
to the element currently being 
pointed at by the outer loop 

• After each iteration of the inner 
loop, the most minimum value in 
the reset of the array is assigned 
to its proper place in the array 

• Is it descending or ascending 
order? How to change that? 



using System; 
- namespace BasicSorting 
{ 

class Exarple- 
{ 

|B static void Main() 

{ 

int[] nums = new int [10]; 
Random rnd = new RandomQ; 
for (int i = 0; i < 10; i++) 
nums[i] = rnd. Next (100); 
Console. WriteLine("The unsorrted array: "); 
DisplaylntArray(nums); 

Console. WriteLine( "The sorted array using insertion s|ort: "); 

InsertionSort(nums); 

DisplaylntArray(nums) ; 

Console. WriteLine( "Press any key to continue:"); 
Console. Read(); 

[ } 

static void InsertionSort(int[] intArray) 
{ 

int inner, temp; 

for (int outer = 1; outer < intArray . Length; outer++) 
{ 

temp = intArray [outer] ; 

while (inner > 0 && intArray[inner - 1] >= temp) 
{ 

intArrayfinner] = intArray[inner - 1]; 

} 

intArrayfinner] = temp; 

} 

. } 

static void DisplayIntArray(int[] intArray) 
{ 

for (int i = 0; i < intArray. Length; i++) 
{ 

Console. WriteLine( "Element {0} is {1}", i, intArray[i] ); 

} 

} 

} 



Report Discussion 




Big-0 analysis 




Definition of big-0 

/(*) is 0(g(x)) orf(x) e 0(g(x)) 
If there is exist C and x 0 > 0 such that fix) < Cg(x) for all x > x 0 



Big-0 Example 



Tin) =-n 2 +-n-3 



By try and error plus intuition (function graphs can be 
helpful) we can find a constant C=7 and n 0 = 1 so that we 
have Cg(n) = In 2 

3 n 5 

r(n) = -n 2 + -n - 3 < C^(n), for alln> 1 



2 

, 5 

, + 2 n " 
so 7(n) isO(n 2 ) 



3 < 7n 2 , for alln> 1 



Note that many other constants can go, but the value of the constant is not 
important for large n (asymptotic analysis) so any constant that satisfies the 
condition can go. Also note that we could say Cg(n)= 7n 3 instead of saying Cg(n)= 
7n 3 but In 2 is the simple function form that satisfies the condition and gives the 
least difference Tin) and g(n). As the asymptotic function gives small differences 
from the evaluated function as it expresses more the asymptote. 



Big-0 rules 1 



For all the following theorems, assume that f(n) is a function of n and that K is an 
arbitrary constant. 



Theorem 1: K is 0(1) 



Theorem 2: A polynomial is 0(the term containing the highest power of n) 



f(n) = In 4 + 3w 2 + 5n + 1 000 is 0(7 n 4 ) 



Theorem 3: K*f(n) is 0(f(n)) [i.e.. constant coefficients can be chopped] 



g(n) = 7» 4 istV) 



Theorem 4: If f(n) is 0(g(n)) and g(n) is 0(h(n)) then f(n) is 0(h(n)). [transitivity] 



f(n) = In 4 + 3/? 2 + 5n + 1000 is 0{n 4 ) 



Theorem 5 : Each of the following functions is big-0 of its successors: 
K [constant] 

log b (n) [always log base 2 if no base is shown] a 
n 

n log b (n) 
n 2 

n to higher powers 

2* 

3 n 

larger constants to the n-th power 

n! [n factorial] ▼ 

n n 



f(n) = 3;? log(w) is 0(n log(w)) and 0(rr ) and 0(2" ) 



Big-0 rules 3 

Theorem 6: In general. f(n) is big-0 of the dominant term of f(n). where 
"dominant" may usually be determined from Theorem 5. 

f(n) = ln 2 + 3/7 log(/?) + 5/? + 1000 is 0(n 2 ) 

g(/7) = 7/7 4 + 3"'+1000000isO(3") 

/?(/?) = 7/?(/7 + log(/?)) is 0(/7 2 ) 

Theorem 7: For any base b. log b (n) is 0(log(n)). 



Big-0 of the three basic sorting algorithms 



Bubble sort 

The worst statement is the comparison statement. It executes f(n) = (n — 1)(1 + 2 + — \- (n 

- 1) = (n - 1) + 2(n - 1) + •■• + (n - l)(n - 1) = k + an + yn 2 
F(n)isO(n 2 ) Bubble sort is 0(n 2 ) 

Selection sort 

The worst statement is the comparison statement. It executes f(n) = (n)((n — 1) + (n — 2) + •■• 
+ •••+1 = k + an + yn 2 
F(n)isO(n 2 ) Selection sort is 0(n 2 ) 
Insertion sort 

The worst statement is the comparison statement. In the worst cases, it executes f(n) = (n 

- 1)(1 + 2 + - + (n - 1) = (n - 1) + 2(n - 1) + - + (n - l)(n -l) = k + an + yn 2 
F(ri)isO(n 2 ) Insertion sort is 0(n 2 ) 

Also the three algorithms gives the same big-0 asymptotically, the insertion sort is the worst one 
because the worst operation is likely to execute much in this algorithm. However, asymptotically, 
they have all the same complexity. 



